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^  ^  1.  INTRODUCTION  f 

The  fact  that  “Poisson  Arrivals  See  Time  Averages*  (PASTA)  has  been  used  repeatedly 
in  the  analysis  of  queueing  systems.  Various  authors  provided  proofs  of  PASTA  under 
varying  assumptions  on  the  observed  process  and  its  relationship  to  the  Poisson  arrivals 
^ In  flo)  it  was  shown  that  PASTA  is  essentially  a  sample  path  property.  The  basic 
^  condition  is  that  the  observed  process  cannot  anticipate  future  jumps  of  the  Poisson  process. 
'  -In- this  paper  we^considers^iis^rete-time  systems.  These  systems  arise  naturally  in  the  study 
of  synchronized  communication  networks  and  can  also  be  considered  as  approximations  of 
continuous-time  systems.  We  assumed  it  hat  the  statistics  of  the  arrival  process  are  governed 
by  an  underlying  denumerable  Markov  chain  and  that  the  observed  process  cannqt  anticipate 
future  arrivals  if  the  current  state  of  the  Markov  chain  is  known.  fWe  -derive  the  relation 
between  the  time  average  of  the  observed  process  and  the  average  of  the  process  as 
observed  by  the  arrivals*.  The  states  of  the  underlying  Markov  chain  are  involved  .in  this 
relation.  Examples  are  given  to  illustrate  the  applicability  of  the  results.  jAs  in  [10]  the 
results  can  be  applied  even  if  the  observing  process  has  a  role  different  than  ^arrival.*1 

I*\ 

2.  MAIN  RESULTS 

On  a  probability  space  (C1.7J*)  consider: 

i)  An  increasing  family  of  cr-fields.  7n ,  n=0,l.... 

ii)  A  sequence  Un.n=  0.1.....  of  random  variables  adapted  to  7n  (i.e.  Un  is  7n  measurable 
for  every  n ). 

iii)  A  sequence  0„,n=l,2 .  of  nonnegative,  integer  valued  random  variables  adapted  to  7n 

iv)  A  sequence  Xn .  n=0.1,...  of  random  variables  adapted  to  7n,  such  that: 

£{en+1/^}=£{en+1/Xj  a*.. n=0.1....  (1) 

Let  /(A).  A  €7.  denote  the  indicator  function  of  the  event  A. 

The  interpretation  of  the  quantities  defined  above  is  the  following: 

i)  7n  is  the  history  of  the  system  up  to  time  n. 

ii)  Un  is  the  observed  process.  Un  is  usually  an  indicator  function.  The  process  of  interest 

is.  say.  Dn  n  =0.1 .  and  Un  =/(Z)„  £B ).  where  B  is  an  event  in  the  state  space  of  Dn. 

iii)  0„  represents  bulk  arrivals. 

iv)  Xn  is  the  process  governing  the  evolution  of  the  arrival  process. 

Let  us  define: 


Zui*i 

1=0 


)6  *=L 


■  -  /V/f  C4i 
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_  1=0 _ 

£/(Xi=0 

1=0 


IJ(Xri) 

1=1 

r„  is  the  time  average  of  the  observed  process  up  to  time  n . 

OS  is  the  average  value  of  Un  that  arrivals  up  to  time  n  see.  just  after  they  arrive. 

is  the  average  value  of  the  process  Un  that  arrivals  up  to  time  n  see.  at  the  last  slot 
before  they  arrive. 

S?A .  SiA .  have  the  same  interpretations  as  OS.  OS  respectively,  if  we  consider  that  an  arrival 
occurs  whenever  Xn—i,i  fixed. 

An  example  where  the  arrivals  have  the  structure  described  above  is  the  output  of  the 
finite  population  slotted  ALOHA  system  ([4],  chapter  8).  In  this  case. 

1  if  a  successful  transmission  occurs  in  slot  n 
“  0  otherwise 

and  Xn  is  the  number  of  blocked  users  in  the  beginning  of  slot  n.  The  output  of  Tree. 
Window  or  Stack  type  Random  Access  Algorithms  can  be  put  in  this  framework  as  well. 
The  same  is  true  for  the  output  of  other  discrete-time  queues.  The  process  Dn  can  be.  for 
example,  the  length  of  a  queue  whose  input  is  the  output  of  a  Random  Access  Algorithm. 
We  are  interested  in  the  relationship  between  the  quantities  defined  in  (2).  as  n  increases  to 
infinity. 

The  following  Theorem  is  the  basis  for  the  subsequent  derivations. 

Theorem  1.  Let  \Un\^B  <oo.  n— 1.2,....  and  £  Then, 

»=i  ti 


I  <//-!©;  ZUi-iEiQi/X^) 

i=i  1=1 


=0  aje. 


Proof.  The  proof  is  similar  to  the  martingale  proof  of  the  Strong  Law  of  Large 
Numbers.  We  include  it  here  for  completeness. 

Let 


:  +G„_1 


n=l 
n=  2.3... 


The  random  variables  C„,  n  =  l,2....  are  integrable: 

£{ICnlK25(£{en2I)*<oo. 

It  follows  that  Gn  is  integrable  for  n  =  l,2....  It  can  also  be  seen  that  [G„Jn_n= 1.2,...}  is 
a  martingale.  Moreover, 


I 


& 


1 

£ 


£ 


£{Gn\ i/?n )‘Gni+—^E[Cn\1/7n  )+2Gn-^E{Cn+lf7n } 

<Gn2+-^-^2£K  i  e„ +1 1  +e[  ie.+1 1/X.  }¥/7n ) 

<G„2+  {™2—(e[*Ui/7«  )+E{Q*+i/Xn }) 

Therefore, 

E  {G2}  <E  [G  t)+4B2Z^*iy2)E{Qhi)  <°°.n  =1.2.... 

It  follows  ([1],  Th.  7.6.10,  p301)  that  Gn  is  uniformly  integrable  and  converges  almost 
everywhere  (and  in  L2)  to  a  finite  limit  G(oo).  Therefore. 

oo  1 

X  ~rCi  =G  (oo)  <  oo  ax. 


The  theorem  now  follows  by  an  application  of  Kronecker’s  Lemma  ([l],  Th  7.1.3,  p270).  □ 

The  following  Corollary  is  the  counterpart  of  the  corresponding  Theorem  for  Poisson 
arrivals  in  continous  time  [10]. 

Corollary  1.  Let  0„ .  71=1,2....  be  a  sequence  of  random  variables  such  that  0„  is  indepen¬ 
dent  of  n=1.2 .  E{Qn}=\n,  and  £-^-£{0i2}<oo.  // 

l= 1‘ 

ih 

lim  — - =\<oo, 

n—oo  n 

then 

iui-fht 

ax.  iff  — - ►XO*,  a.e. 

ft 

Therefore,  if  \n  =X.  n  =1.2 then , 

On~*Oto  a.e.  iff  Tn-*Tm=Ot,  ax. 


Proof.  In  Theorem  1..  let  Xn=Qn,  n=1.2,.„  X0=constant.  Then 


lim 

/»-*<» 


Lui-i®i  !©<  LUi-ih 

i -i  i=i  i=i 


n 

i=i 


n 


=0  ax. 


By  Kolmogorov’s  Strong  Law  of  Large  Numbers  ([l],  Th.  7.2.2,  p274). 


I^-ix, 

i=i  i=i 


*0  ax. 


The  rest  of  the  Corollary  follows  easily.  □ 

Remark.  Note  that  it  is  not  required  that  the  random  variables  0„  be  identically  dis¬ 
tributed.  On  the  other  hand  if  the  random  variables  0„  are  independent  identically  distri¬ 
buted  (i.i.d).  the  restriction  on  the  second  moments  is  not  necessary. 
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Corollary  2.  If  0„  are  iid.  random  variables  with  finite  mean,  then 

0*->OLa*.  iff  Tn 

Proof.  The  proof  is  entirely  analogous  to  the  corresponding  proof  of  the  Strong  Law 
of  Large  Numbers  ([l],  Th  7.2.5.  p275)  and  will  be  omitted.  We  only  note  that  in  the 
proof,  instead  of  refering  to  the  Strong  Law  of  Large  Numbers  with  finite  second  moments, 
one  should  refer  to  Theorem  1.  □ 

We  now  state  the  conditions  for  the  main  Corollary  concerning  the  nonindependent 

case. 

Let  Xn  n=1.2 .  be  an  irreducible,  homogeneous,  denumerable  Markov  chain  with  state 

space  t,  and  transition  probabilities  pti  =P(Xn+1= j/Xn  =i ).  Let  H  be  the  state  space  of 
0„,  WC  {0.1.2....}.  Let  Dt  =E  {0„ +l/Xn  =i } .  independent  of  n.  and  M,  =E  {02+1/X„  =t }.  indepen¬ 
dent  of  n. 

Corollary  3.  Let  I Un  I  <oo  ae. .  n  =1,2,...  Let  Xn  be  ergodic  with  stationary  probabilities 

iri.iZC.  If 

Afi<M<oo.  i€C  (3) 


-*Sf>00  ae..ieC 


SL  -»5,* oo  .  *  €  L.  0*^01  a*. .  TH  -T*  a*. 


and  the  following  equalities  hold: 

°«(  Z  A Z  A^S?,. .  ae. 

i€£  it£ 

Sj'Coirj  =  £  it j Pij Sfjao .  i.jtC.  ae. 
it£ 

Too-  £  fTiStoo  =  L  7T,5f,oo .  ae. 
it£  it  C 

Proof.  From  (3)  it  follows  that 

£{0„2}<Af.n=1.2,... 

Therefore.  Theorem  1  applies  with  Un= 1. 


lim  — 

n—co  n 


L©i  £2?{0,/X,_1} 

i=i  i-i 


Because  of  (3).  sugDt<  oo.  and  therefore. 

Z  A 7ri  <«> 

it  c 

From  (7)  and  Th.2  in  [3]  p92,  it  follows  that 

tEiQt/Xt-J 

lim  — - -  Z 

n-»oo  /l 

From  (6)  and  (8)  we  see  that 


-=  £  A  Wi,  a.e. 

it  c 


Observe  now  that  E{Qn+JXn  }=  £Z)j/(X,,=i).  and  apply  Theorem  1  again: 

«€£ 


=0  ait. 


lim 

n  ~*oo 

iUi-iQt 

1=1 
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Z  e, 

1*1 

£  ££/,_!!>, /(Xi-i=0 

i€£;=i 

n 

Z©< 

n 

n 

/ =1 

Also, 


££/,_!/(*,_!=» )  ££/i_1/(X,_1=i)  £/(*,_!=* ) 

/— 1  / =i  i=i 


n 


i=i 


Sf  aa  Vi  aje. 


Let  Am  be  an  arbitrary  finite  subset  of  C.  Since 

lf/1_1Di/(Xi_1=i)l  ZBDiHXt-t-i). 

it  can  be  seen  that. 


(10) 


(11) 


(12) 


z  z^-iA /(*,-!=;) 

i(Cl=l 
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£  d, 
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lsl*K 
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(13) 


Exactly  as  in  the  proof  of  (8).  we  have  that. 


lim- 

n—oo 


Z  Z  DiUXt- !=i) 
,sl*K _ 

n 


-=  £  DiVi  a£. 
itAl 


(14) 


From  (11),  (13).  (14).  (7)  and  the  arbitrariness  of  Am  we  conclude  that. 


lim' 

n  -*oo 


£  tUt-ilOCt-t-O 

iCCl= 1 


n 


’  Z  DftTfSfji 

i€£ 


a.e. 


(15) 


Formula  (4.a)  is  established  by  combining  (9).  (10)  and  (15).  Formula  (4.b)  follows 
immediately  by  setting  9„  =/  (Xn  =  j ).  To  prove  formula  (4.c)  observe  that 


Un=  Z  Un I(Xn  +1=i  )=  £  Un  I{Xn  =i)  aa. 

i€  t  i€  C 


and  apply  the  arguments  used  to  prove  (15).  □ 

Remarks,  i)  If  D,  is  constant,  it  follows  from  (4.a)  and  (4.c)  that  1^=0^ .  Therefore, 
in  this  case  arrivals  see  time  averages.  Note  that  independence  is  not  necessary, 
ii)  A  particularly  simple  relation  holds  if  £={0,1}  and  On=I(Xn=l).  In  this  case  we  have 
from  (4.b), 

O*,ir1=5i.007ri=7r1/>US!,00  +7r0/>0iSo.oo 


=7rlP  1101,00  +W0F01S0.OO  0£. 


Also,  from  (4.c), 


Therefore. 


T00=7r1Of>00  +7ToSo,oo  a-e- 


Oto  (pn  Poi)@a°  ~  TBOa£. 

Vi 


Formula  (16)  involves  only  the  quantities  seen  by  arrivals  and  the  time  average  of  the  pro¬ 
cess-  It  will  be  used  in  Section  3.2. 

iii)  The  quantities  0%.  0„.  represent  the  averages  of  the  process  observed  by  bulk  arrivals. 
In  practice  the  average  of  the  process  observed  by  a  particular  user  is  of  interest. 
Specifically,  for  l  arrivals,  the  quantities  of  interest  are: 


I  Urm 

m= 1 


LVtm-  i 

.  o?=m- - 


where  Tm  is  the  time  of  the  l  th  arrival. 

Under  the  conditions  of  Corollary  3.  it  can  be  shown  using  standard  ratio  limit  arguments, 
that. 


lim On—Olo  a£.  iff  llm0f=0^=O«  a.e. 

n  ~*oo  l  -*oo 


lim 0„=0t,  a.e.  iff  lim 0*=0£,=OZa  a  e- 

n-*oo  l  -*oo 


If  the  0„  are  i.i.d..  the  restriction  on  the  second  moments  is  not  necessary, 
iv)  The  formulation  in  this  section  was  in  terms  of  sample  averages.  Results  can  also  be 
obtained  in  terms  of  limiting  probabilities.  Consider  the  following  example,  useful  in  appli¬ 
cations.  Let  Tm.  be  a  sequence  of  random  variables  taking  positive,  integer  values. 

Let  Tm .  m =1.2....  be  independent  of  Dn  n*=  1.2.....  If  lim Tm  =oo  a£.  and 

m-*oo 


UmHDn=n=P, 


lim  P(Dr  —l')— Pi 


The  result  follows  by  observing  that 


P(DTm  =1  )=  Z  P(Dn  =1  f|  Tm  =n )=  L  P(Dn  =1  )PiTm  =n  ) 

n =1  »=1 


lim  P(Tm=n )=0,  n=  1,2,... 

m—  oo 


Let  now  Dn .  n  =1.2....  be  independent  of  8„ .  n=l,2,„.  and  let  Tm  be  the  time  of  the 
mth  arrival.  Then  Dr  is  the  value  of  Dn  observed  by  the  mth  arrival.  If  limrm=oo  a.e. , 


which  is  usually  the  case  in  practical  systems,  then  the  limiting  probabilities  of  Drm  and 
Dn  are  the  same.  Note  that  no  assumptions  on  the  statistics  of  the  two  processes  are 
required. 


3.  APPLICATIONS 


Consider  a  communication  node  consisting  of  c  servers.  Time  is  divided  in  intervals  of 
constant  length,  called  slots.  The  unit  of  time  is  the  length  of  a  slot.  Slot  n.,n=l,2 


I 

g 

s 


I 

I 

I 

i 


occupies  the  time  interval  [n— l.n).  During  a  time  slot  n,  a  number  of  messages  9„  arrives 
in  the  node.  The  length  of  message  i  is  Zj  slots.  The  processes  0„  and  Zf  consist  of  i.i.d. 
random  variables,  and  are  independent. 

Define: 

Nn:  The  size  of  the  queue  at  the  beginning  of  slot  n  (just  after  the  arrivals  9„). 

The  number  of  messages  whose  service  is  completed  in  slot  n. 

A/£:  The  value  of  Nn  in  the  slot  just  prior  to  the  mth  arrival. 

M„\  The  value  of  Mn=Nn—In  in  the  slot  just  prior  to  the  mth  arrival. 

Let 


7b=?(0,,O</4,  Zz,1<Z<oo,  No) 

(17) 

If  £{0„ }  <cE\Zt  }-1,  ergodic  conditions  hold.  Considering  the  system 
Lave  from  Corollary  2 

in  steady  state,  we 

P(N*,=l)=HNn=l).l=  0,1,... 

(18) 

and 

P(M*,=l)=P(Mn=l).l  =  0.1.... 

(19) 

Since  Mn^Nn,  we  have  that 

P(Mn  <Z)<i>(iVB  ^l).  1=0.1.... 

(20) 

Also.  Nn+l=Mn+Qn^Mn.  Therefore. 

P(.Nn+l<l)=P(Nn  <Z)<i>(M„  <Z).  Z=0,1.... 

(21) 

From  (20)  and  (21)  we  conclude  that 

P(Mn  =Z  )=P(Nn  =Z ),  l  =0.1,... 

(22) 

Therefore. 

P(.Mm=D=P(.Nn=l),  Z=0,1... 

(23) 

Property  (23)  was  used  in  [2]  for  the  analysis  of  the  GIIGI1  discrete-time  queue.  It 
seems  that  in  [2],  Mn  was  confused  with  Nn .  but  as  formula  (22)  shows,  this  does  not 
alter  the  final  result. 
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3.2  Star  network  with  Markovian  inputs. 


This  system  was  studied  in  [8 J.  An  infinite  buffer  in  a  node  accepts  messages  from  K 
links.  Time  is  slotted.  In  slot  n.  link  i  generates  one  or  zero  messages.  The  length  of  a 
message  is  constant,  equal  to  one  slot.  One  message  is  processed  per  slot  by  the  node. 


Let 


ei  = 


1  if  one  message  is  generated  at  link  i  in  slot  n 
0  otherwise 


The  sequences  {0^,  n=l,2,...}  are  homogeneous  Markov  chains  for  1  ^  £  .  and  independent. 

Let 


pi,=P(&Ui=s/& j  =r)>  0 


i 

R 


yi=p‘u-p‘oi 
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We  define 

Nn:  The  size  of  the  queue  at  the  beginning  of  slot  n  (just  after  the  arrivals). 

Ni„: The  value  of  Nn  in  the  slot  just  prior  to  the  mth  arrival  at  link  i. 
iVf^rThe  value  of  Nn  in  the  slot  of  the  mth  arrival  at  link  i. 

8{„: The  number  of  arrivals  at  link  j,  in  the  slot  of  the  mth  arrival  at  link  i,  i^j. 

Iljn:  The  number  of  messages  completing  service  in  the  slot  of  the  mth  arrival  at  link  i . 
Wi/n: 

The  delay  of  the  mth  arrival  at  link  i. 

N„:  The  number  of  messages  from  link  i  in  the  queue,  at  slot  n. 

We  will  provide  the  formula  for  the  mean  queue  lenght  and.  consequently,  the  average 
waiting  time  of  a  message.  This  formula  was  derived  in  [8].  The  procedure  followed  in  [8] 
relies  on  the  computation  of  the  characteristic  function  of  the  queue  length.  We  present 
here  a  simplified  proof  that  is  based  on  probabilistic  arguments.  In  addition,  the  average 
waiting  time  of  a  message  at  a  particular  link,  and  the  probability  of  zero  queue  lenght  in 
the  slot  just  prior  to  the  arrival  of  this  message,  are  derived  during  the  proof. 

The  queue  discipline  is  first-come  first-served.  Let  us  assume  for  simplicity  that  if 
links  *i<»2  generate  messages  at  the  same  slot,  link  is  served  first. 

K 

If  £otj<l.  ergodic  conditions  hold.  We  consider  the  system  in  steady  state.  Let 

i=  1 

0 <n.  1  <K.  No) 

From  formula  (16)  we  have  that 

i»(iV^=O-yjP(M%1=/)=(l-yi)i,(^=O.Z=0.1 .  l^i^K  (24) 

Therefore 

E{N^/n)-yiE{NtJ<l-yi)E{Nn).  1  (25) 

Observe  now,  that 

Nf^Nf^  £  eU+i-ii„. 

Kj  <L  (26) 

From  Remark  iv)  in  Section  2,  we  easily  conclude  that 

P(QU><xj=E{QU  (27) 

Therefore,  from  (26)  we  have  that 


From  (24  )  we  see  that 


E{N?J=E{N?„)+  Z  <*j  ~<*i  +P(Nj>/n=0) 
J= i 


P(N?„  =0)~y  =0)=(  1— y,.  )P{Nn  =0) 


But  N?„  ^  1  and  therefore.  PiNf^  =0)=0  Also.  POVn=0)=l-£a(  .  This  can  be  proved  as  in 

i=l 

example  11-8.  p400.  in  [5J.  Although  the  GUGIc  queue  is  treated  in  [5],  the  proof  goes 
through  in  our  case.  Therefore, 

P(J*Um OMl-y,  )P{N,  =o)=(i-yj XI-  Z  «J )  (30) 

1 


(31) 


Combining  (28)  and  (30)  we  get 


E{N?„\=E{N?„)+  £  aj  -a,  +(1— y,  )(l-  £  *j ) 

)=i  j= i 


Next,  observe  that1 


Therefore. 


i-i 


^^=^+£0/^  +  1-/;, 


E { W, „ }  =E { NU 1 + Z  +( 1-y i )( 1-  £  aj) 

j=i  j= l 

By  Little’s  formula  applied  to  each  link  separately,  we  have  that 

aiE{Wi/n)=E{N'n). 

Therefore 

£ai£{Wj^}=££{iV‘}=£{Nj 

i=l  i=l 

From  (25),  (31)  and  (33)  we  find  that 


(32) 

(33) 

(34) 

(35) 


1-y,  i;. 

Finally,  from  (35)  and  (36)  we  conclude  after  some  simple  algebra,  that 


K  K 

Z 

£{ArJ=i^i - 


1— Ti 


K 

1-Z«i 

i  =1 


+  Z«i 

i=l 


(36) 


(37) 


Formula  (37)  is  derived  in  [8],  Formula  (36)  provides  the  expected  delay  of  a  message 
arriving  at  link  i.  Formula  (30)  provides  the  probability  that  a  message  arriving  at  link  i 
will  find  the  queue  at  the  previous  slot  empty. 


3.3  Queues  with  Input  Controlled  bv  a  Markov  Chain. 

Consider  a  discrete-time  (slotted)  queue.  Let  9„,n=0,l .  be  the  number  of  messages 

generated  in  a  slot.  Let  Xn .  n  =0,1 .  be  a  process  with  denumerable  state  space  £,  such 

that  for  any  nonnegative  integers  n .  h.  r .  rj,  .  .  .  ,  r„ .  and  any  j .  i .  »i,  .  .  .  ,  i„  from  the 
state  space  t,  the  following  equality  holds: 

i>(0„+1=/i,  Xn^i=j  /  Xn=i .  Xn-i=ii . X0=i„,  0„=r ,  0„_!=r  j,  .  .  .  ,  90=rn)  (38) 


“^’(©n+r-^.  Xn+i -j  /  Xn  —i 

The  length  of  message  i  is  Zj  slots.  The  sequence  Z;,£=l,2 .  consists  of  i.i.d.  random 

variables  and  is  independent  of  the  sequences  9„  and  Xn.  The  output  of  many  Random 
Access  Algorithms  as  well  as  the  output  of  other  discrete-time  queues,  has  the  statistical 
structure  of  8„. 


- 5 - 

lWt  adopt  the  notation,  £  =0  if  a>b. 


A  complete  study  of  queues  of  the  type  described  in  the  previous  paragraph  is  outside 
the  scope  of  the  present  paper.  We  will  illustrate  here  how  the  steady  state  distribution  of 
the  delay  is  related  to  the  steady  state  distribution  of  the  queue  length  in  the  case  where 
Z;  are  geometrically  distributed  with  parameter  — 

P(Zi=*)=p(l-p)t-1.Jfc=1.2....  (39) 


We  will  also  assume  that  8„  is  either  zero  or  one.  The  process  Xn  is  a  Markov  chain 
with  transition  probabilities 

P(Xn+i=j/Xn  =i  )=pij  =?,o.i)+?i0.o)  (40) 

We  assume  that  Xn  is  irreducible,  aperiodic  and  ergodic.  The  process  (Xn .  9„ ).  is  also  a 
Markov  chain  with  transition  probabilities 

f(Xn+i -j.  ©„+i=A  /  Xn=i.  Qn=r)=P(is)Q'h)=qi.()jl)  (41) 

We  assume  that  (Xn ,  9„ )  is  irreducible  and  aperiodic.  Since  Xn  is  ergodic.  it  follows  that 
(X„ .  0„ )  is  ergodic  with  stationary  transition  probabilities 

«‘(M>=Z?iOA)lri’  /€£./i=1.0  (42) 

i€  L  K  J 

Formula  (42)  follows  easily  by  noting  that  the  numbers  tt<j satisfy  the  equilibrium  equa¬ 
tions  for  the  Markov  chain  (X„ .  9„  ),  and  that  £  £  ir(j  Ji)=  £  ttj  =1. 

1  )£C 

Let  Nn.  Nn=N\„.  N„=N\/n  be  as  defined  in  Section  3.2.  Let  also, 

r  )/n  ■ 

The  number  of  messages  in  the  queue,  in  the  slot  of  the  mth  occurrence  of  state 
(t.r)  (i.e..  the  mth  time  that  Xn  =i .  9„  —r  for  some  n.) 

The  number  of  messages  in  the  queue,  in  the  slot  before  the  mth  occurrence  of  state 
(is). 

The  number  of  arrivals  in  the  slot  of  the  mth  occurrence  of  state  (is). 

J  Ur)sn- 

The  number  of  messages  completing  service  in  the  slot  of  the  mth  occurrence  of  state 

(is). 


Wm :  The  delay  of  the  mth  arrival  in  the  system. 

To  simplify  the  notation  we  will  omit  the  indices  m ,  n  whenever  there  is  no  danger 
for  confusion.  We  consider  that  (Xn.Q„)  is  the  underlying  Markov  chain.  Then, 


D(ir)  E{On+\/Xn  —i  ,  8„  —  T  }—  £  9i(j,l) 

jec 

We  assume  that 

2 

L  'LD(irWUr)-'L  9i0.l)*r«  <P 

i€£r= 1 


(43) 

(44) 


Under  (44),  the  system  can  be  considered  in  steady  state.2  From  Corollary  3,  we  obtain 

P(N  —• l)  £  £  9>.(j  .i)1ri  =  22  E D(i/.)‘ir(j/.)P(Mfi/.)=l)  (45.a) 

ii£)*£  Cr  =1 


1  The  existence  of  steady  state  can  be  established,  for  example,  by  the  methods  of  Ch.l  in:  Borovkov,  A.  A. 
Stochastic  Processes  in  Queueing  Theory.  New  York:  Springer-Verlag  1976. 


(45.b) 


Z  *)P(tfir >=Z).  /'  €£.  /i=0,l 

i€£  i€£r=l 


Observe  that 


Therefore. 


PW=/)=ZI’r(i/)f(%)=0 

i€£r=X 


i  €£.  r=  0.1 


Wfl.i)=D  =  PC^.ipZ-1)  (1-p)  +  P(^U)=Z)  p.  Z=l,2...  i  €£ 


(45  .c) 


(46) 


(47.a) 


K>/fj.i)=0)  =  0.i€£  (47.b) 

P(.M?i.o)=0  =  H^i.o)=D  (1-p)  +  P(^.o>=Z+l)  p.  Z=1.2.„,  i  €£  (47.c) 

/>(^i.o)=0)  =  i,(^i.O)=0)  +  P(Mfrfi)=l)  p.  Z  €  £  (47.d) 


Equations  (45)  and  (47)  relate  the  steady  state  distribution  of  ZV*  to  the  steady  state 
distribution  of  ZV„.  Since 


W„ 


Zm 

Ni 


£Zi+Zm-l 

w 


if^=0 
if  ZV‘=1.2... 


(48) 


where  the  random  variables  Zt  are  independent  geometrically  distributed,  the  steady  state 
distribution  of  Wm  can  be  determined  from  the  distribution  of  ZV£ 


4.  CONCLUSIONS 

We  presented  the  relation  between  the  time  average  of  a  process  and  the  average  of 
the  same  process  as  observed  by  arrivals,  in  discrete  time.  The  observing  process  is  con¬ 
trolled  by  an  underlying  Markov  chain  and  is  usually  identified  with  the  arrival  process, 
but  the  derived  relations  are  independent  of  this  identification.  The  results  were  applied  to 
the  study  of  certain  discrete-time  systems.  It  is  believed  that  the  results  will  facilitate  the 
analysis  of  other  discrete-time  systems,  and  that  they  have  counterparts  in  continuous-time 
systems. 
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